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METI (CD AND APPARATUS I'OR ENCODING INTERLACED 
MACROBLOCK T FIXTURE !NI ; ORMATlON 



RELATED APPL1CA1 ION 

More Lhan one reissue app l ication has been filed. The present reissue application serial No. 
12/13U723 is a conli nuai ion of the reissue application Serial No. 12/131.712. both of which filed 
on th e same date of June 2. 2008. each of which is a continuation of the reissue application 
serial No. 10/61 1.938. filed on July 3,2003. which is a reissue application of U.S. patent 
\o.6.259J32 HL which issued on July UK 2001 from U.S. application No. 09/088,375 and 
which claims priority under 35 U.S C $119 from Korean patent application No. KR 9cS-S637. 
filed on March 14, 1998, the en tire c ontent of each is incorporated herein bv reference. 



.'ILL I ) OF Tl IK IN VfiNTTON 

fhe present invention relates To a method and apparatus for encoding interlaced maeroblock 
'ex Lure information; and. more particularly, to a method and apparatus for padding interlaced 
i ex lure information on a reference VOP on a texture maeroblock basis in order to perform a 
motion estimation while using the interlaced coding technique. 

DESCRIPTION OF TIIE PRIOR ART 

"n digital I y televised systems such as video-telephone, teleconference and high delhulion 
elcvision systems, a large amount of digital data is needed to define each video frame signal 
since a video line signal in the video frame signal comprises a sequence of digital data referred to 
as pixel values. Since, however, the available frequency bandwidth of a conventional 
transmission channel is limited, in order to transmit the large amount of digital data therethrough, 
it is necessary to compress or reduce the volume of data through the use of various data 
I'urncrCsSion techniques, especially in the case of such low bit-rate video signal encoders as 
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video-telephone and teleconference systems. 

One of such techniques for encoding video signals for a low bit-rate encoding system is the so- 
called object-oriented analysis-synthesis coding technique, wherein an input video image is 
divided into objects, and three sets of parameters lor defining the motion, contour and pixel data 
of each object are processed through different encoding channels. 

One example of object-oriented coding scheme is the so-called MPl£G(Moving Picture Express 
Group) phase 4(MPEG-4), which is designed to provide an audio-visual coding standard for 
allowing content-based interactivity, improved coding efficiency and/or universal accessibility in 
such applications as low-bit rate communication, interactive multimedia(e.g.. games, interactive 
[*V. etc.) and area surveillance(see, for instance, MPEG-4 Video Verification Model Version 7.0, 
International Organisation for Standardisation, ISO/IRC JT f M /SC29/WG 11 MPEG97/N1642, . 
Apr. 1007). 

According to the MPLG-4, an input video image is divided into a plurality of video object 
planesfVOP's), which correspond to entities in a bitstrcam that a user can access and manipulate. 
\ V()P can be referred to as an object and represented by a bounding rectangle whose width and 
height may be the smallest multiples of 16 pixels(a macroblock size) surrounding each object so 
thai the encoder may process the input video image on a VOP-by-VOP basis, i.e., an objcci-by- 
object basis. 

\ V()P disclosed in the MPFG-4 includes shape information and texture information for an 
object therein which are represented by a plurality of macroblocks on the VOP, each of 
macroblocks having, e.g., I6.times.16 pixels, wherein the shape information is represented in 
binary shape signals and the texture information includes luminance and chrominance data. 

Since the texture information for two input video images sequentially received has temporal 
,-edmidancies- il is desirable to reduce die temporal redundancies therein by using a motion 
estimation and compensation technique in order to efficiently encode the texture information. 
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• n order to perforin Lhc motion estimation aiid compensation, a reference VOP, e.g.. a previous 
VOP. should be padded by a progressive image padding technique, i.e., a conventional repetitive 
padding technique. In principle, the repetitive padding technique fills the transparent area outside 
lhc object of the VOP by repeating boundary pixels of the object, wherein the boundary pixels 
are located on the contour of the object. It is preferable to perform the repetitive padding 
technique with respect to the reconstructed shape information. Jf transparent pixels in a 
transparent area outside the object can be filled by the repetition of more than one boundary pixel, 
die average of the repeated values is taken as a padded value. This progressive padding process 
is generally divided into 3 steps: a horizontal repetitive padding: a vertical repetitive padding and 
.m CMCrior padding(see, MFF.G-4 Video Verification Model Version 7.0) 

While the progressive padding process as described above may be used to encode progressive 
texture information which has a larger spacial correlation between rows on a macroblock basis, 
the coding efficiency thereof may be low if the motion of an object within a VOP or a frame is 
considerably large. Therefore, prior to performing the motion estimation and compensation on a 
field- by-field basis for an interlaced texture information with the fast movement such as a 
sporting event, horse racing and car racing, an interlaced padding process may be preferable to 
.he progressive padding process, wherein in the interlaced padding process a macroblock is 
divided into two field blocks and padding is carried out on a field block basis. 

However, if all field blocks are padded without considering their correlation between fields, 
jcrurn field blocks may not be properly padded. 

SI "\1 MARY OF THE INVENTION 

It is. therefore, an object of the invention to provide a method and apparatus capable of padding 
.he interlaced texture information considering its correlation between fields. 

In accordance with the invention, there is provided a method for encoding interlaced texture 
nformaxion on a texture macroblock basis through a motion estimation between a current VOP 
ind i s one or more reference VOP's\ wherein each texture macroblock of the current and the 
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reference VOP's has M.iimcs.N defined or undefined texture pixels. M and N being positive even 
integers, respectively, Lhe method comprising the steps of: 

(a) delecting whether said each texture macro block of each reference VOP is a boundary block 
or not, wherein the boundary block has at least one defined texture pixel and at least one 
undefined lex lure pixel; 

(b) dividing the boundary block into two field blocks, each field block having M/2.Limes.N 
texture pixels; 

c) extrapolating the undefined texture pixels of each Held block based on the defined texture 
pixels thereof to generate an extrapolated boundary block for said two field blocks; and 

. d) if the boundary block has an undefined field block and a defined field block, padding the 
undefined field block based on xhc defined field block, wherein the undefined field block and the 
defined field block represent one field block having the undefined texture pixels only and the 
other field block having ai least one defined texture pixel, respectively. 



BRIKF DESCRIPTION OF THE DRAWINGS 



The above and other objects and features of the present invention will become apparent from the 
following description of preferred embodiments given in conjunction with the accompanying 
drawings, in which: 

i- ICS. I shows a schematic block diagram of an apparatus for encoding interlaced texture 
nformation of an object in a video signal in accordance with the present invention; 

2 presents a flowchart for illustrating the operation of the reference frame processing 
.:ircu i shown in Kid. I; 

• IGS. 3 A and 313 describe an exemplary boundary macroblock and a top and a bottom bouiidar> 
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field blocks for the boundary macrobloek, respectively; 

FIGS 3C to 3£ represent a padding procedure of the top and the bouom boundary field blocks 
sequentially in accordance with the present invention; and 

FIG, 4 depicts a plurality of undefined adjacent blocks lor an exemplary VOP and the padding 
directions for each undefined adjacent block. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Referring 10 FIG. 1 , there is shown a schematic block diagram of an apparatus for encoding 
texture information on a current VOP. The texture information partitioned into a plurality of 
icxlure macroblocks is applied to a division circuit 102 on o texture macrobloek basis, wherein 
each texture macrobloek has M.timcs.N texture pixels, M and N being positive even integers 
topically ranging between 4 and 16. 

I he division circuit 102 divides each texture macrobloek into a top and a bottom field blocks 
which may be referred lo as interlaced texture information, wherein the top field block having 
M/2.timcs.N texture pixels contains every odd row of each lexlure macrobloek and the bottom 
feld Mock having the other M/2. times. N texture pixels contains every even row of each texture 
macrobloek. The top and the bottom Held blocks for each texture macrobloek are sequentially 
provided as a current lop and a current bottom field blocks, respectively, to a subtracter 104 and 
a motion estimator 1 16. 

Reference, e.g., previous interlaced texture information, i.e., interlaced texture information of a 
reference VOP. is read out from a reference frame processing circuit 1 14 and provided to the 
motion estimator 1 16 and a motion compensator 1 18. The reference VOP is also partitioned into 
a plurality of search regions and each search region is divided into a top and a bottom search 
regions, wherein the cop search regions having a predetermined number, e.g., P(M/2.times.rT) of 
reference pixels contains every odd row of each search region and the bottom search region 
having the predetermined number of reference pixels contains every even row of each search 
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region, P being a positive integer, typically, 2. 

The motion estimator 1 1 6 determines a motion vector for each current top or bottom Held block 
on a ficld-by-ficld basis, First, the motion estimator 1 16 detects two reference field blocks, i.e., a 
reference top and a reference bottom field blocks for each current top or bottom field block, 
wherein the two reference field blocks within the top and bottom search regions, respectively, are 
located at a same position as each current top or bottom field block. Since the top and the bottom 
search regions have a plurality of candidate top and candidate bottom field blocks including the 
reference top and the reference bottom Held blocks, respectively, each current top or bottom field 
block can be displaced on a pixel-by-pixel basis within the lop and the bottom search regions to 
correspond with a candidate top and a candidate bottom field blocks for each displacement, 
respectively; at all possible displacements, errors between each current lop or boilom field block 
and all candidate top and bottom field blocks therefore arc calculated to be compared with one 
another; and selects, as an optimum candidate field block or a most similar field block, a 
candidate top or bottom field block which yields a minimum error. Outputs from the motion 
estimator 1 16 are a motion vector and a field indication flag being provided to the motion 
compensator 1 18 and a statistical coding circuit 108 by using, e.g.. a variable length 
codinu(VLC) discipline, wherein the motion vector denotes a displacement between each Current 
lop or bottom field block and the optimum candidate field block and the field indication Hag 
represents whether the optimum candidate field block belongs, to the top scorch region or not. 

f he motion compensator 1 1 provides the optimum candidate field block as a predicted top or 
xmom field block for each current top or bottom field block based on the motion vector and the 
field indication flag ro the subtractor 104 and an adder 112. 

The subtractor 104 obtains an error field block by subtracting the predicted top or bottom field 
->lock from each current top or bottom field block on a corresponding pixel-by-pixel basis, to 
provide the error field block to a texture encoding circuit 106. 

in the texture encoding circuit 106, the error field block is subjected to an orthogonal transform 
:br removing spatial redundancy thereof and then transform coefficients are quantized, to thereby 
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provide the quantized transform coefficients to the statistical coding circuit 108 and a texture 
reconstruction circuit 1 1 0. Since a conventional orthogonal transform such as a discrete cosine 
iranslorm(DCT) is performed on a OCT block-by-DCT block basis, each DCT block having 
typically S.times.8 texture pixels, the error field block having 8.times.l6 error texture pixels may 
l>c preferably divided into two DCT blocks in the texture encoding circuit 106. If necessary, 
before performing the DCT, each error field block may be DCT-paddcd based on the shape 
information or the reconstructed shape information of each VOP in order to reduce higher 
frequency components which may be generated in the DCT processing. For example, a 
predetermined value, e.g., *0\ may he assigned to the error texture pixels at the exterior of the 
contour in each VOP. 

The statistical coding circuit 108 performs a .statistical encoding on the quantized transform 
coefficients fed from the texture encoding circuit 106 and the field indication flag and the motion 
\ ecior. for each current top or bottom field block, fed from the motion estimator 1 1 G by using, 
e.g.. a conventional variable length coding technique, to thereby provide statistically encoded 
data to a transmitter (not shown) for the transmission thereof. 

In the meantime, the texture reconstruction circuit 1 1 0 performs an inverse quantization and 
hverse transform on the quantized transform coefficients to provide a reconstructed error field 
block, which corresponds to the error field block, to the adder 1 12. The adder 112 combines the 
reconstructed error field block from the texture reconstruction circuit 110 and the predicted top 
or bottom field block from the motion compensator 1 18 on a pixd-by-pixd basis, to thereby 
provide a combined result as a reconstructed top or bottom Held block for each current top or 
tottom field block to the reference frame processing circuit 1 14. 

1 he reference frame processing circuit 1 14 sequentially pads the reconstructed top or bottom 
f eld block based on the shape information or the reconstructed shape information for the current 
VOP. to thereby store the padded top and bottom field blocks as another reference interlaced 
texture information for a subsequent current VOP to the motion estimator 1 16 and the motion 
compensator 118. 
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Referring to FIG. 2, there is a flow chart for illustrating the operation of the reference frame 
processing circuit 1 14 shown in FIG. 1. 

At step S20L the reconstructed top or bottom field block is sequentially received and. at step 
$203. exterior pixels in the reconstructed top or bottom field block are eliminated based on the 
shape information, wherein the exterior pixels are located al the outside of the contour for the 
object. The reconstructed shape information may be used on behalf of the shape information. 
While the exterior pixels are eliminated to be set as transparent pixels, i.e., undefined texture 
pixels, die remaining interior pixels in the reconstructed top or bottom field block are provided as 
defined texture pixels on a Held block-by-licld block basis. 

\i step S204, each reconstructed block having a reconstructed top and its corresponding 
reconstructed bottom field blocks is determined whether or not being traversed by the contour of 
:he object. In other words, each reconstructed block is determined as an interior block, a 
ooundary block, or an exterior block, wherein the interior block has only the defined texture 
pixels, the exterior block has only the undefined texture pixels and the boundary block has both 
the defined texture pixels and the undefined texture pixels. Tfthe reconstructed block is 
determined as an interior block, at step S2!0, no padding is performed and the process goes to 
step S208. 

rr the reconstructed block is a boundary block BB as shown in FIG. 3 A. at steps S221 to S224. 
the undefined texture pixels of the boundary block are extrapolated from the defined texture 
pixels thereof to generate an extrapolated boundary block, wherein each of squares is a texture 
pixel, each shaded square being a defined texture pixel and each white one being a undefined 
;exrure pixel. 

First, at step S221 , the boundary block is divided into a top and a bottom boundary field blocks T 
.md B as shown in HCi. 3B, wherein each boundary field block has M/2.times.N texture pixels, 
i.e.. tt. limes. 1 6 texture pixels so that the top and the bottom field blocks T and li have M/2. i.e„ 8 
rows Tl to T8 and Bl to B8, respectively. 
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At step S222. the undefined texture pixels are padded on a row-by-row basis by using a 
horizontal repetitive padding technique as shown in FIG. 3C to generate a padded row for each 
• if rows BL 132 and B4 lo B8. In other words, the undefined texture pixels are filled by repeating 
boundary pixels toward the arrows as shown in FIG. 3C, wherein each boundary pixel among the 
defined texture pixels is located on die contour, i.e., the border, of the object. If there exist 
undefined texture pixels which may be padded by the repetition of more than one boundary pixel, 
the average value of the repealed values is used. 

If there exist one or more transparent rows, having the undefined texture pixels only, on each top 
or bottom field block, at step S223, each transparent row is padded by using one or more nearest 
defined or padded rows among the corresponding top or bottom field block, wherein the defined 
row has all the defined texture pixels therein. For example, as shown in FIG. 3D, each undefined 
texture pixel of the transparent row H3 shown in the bottom field block is padded with an 
average of two defined or padded texture pixels based on a nearest upward and a nearest 
t.ownward padded rows, i.e., the 2nd and the 4lh padded rows B2 and B4 in the bottom field 
block B. If the transparent row is located at the highest or the lowest row, i.e.. corresponds to the 
1st row 1 or the 8th row, each texture pixel is padded with a defined or padded texture pixel of 
the nearest padded or defined row. 

If there exists one transparent boundary field block in the boundary block as shown in FIG. 3B. 
at step S224, the transparent boundary field block is padded based on the other boundary field 
block of the boundary block, wherein the transparent boundary field block, i.e., an undefined 
f eld block has no defined texture pixel therein. In other words, if a Lop field block is transparent, 
all the undefined texture pixels thereof may be padded with a constant, value P as shown in FIG. 
3K. c.ji.. a mean value of the defined texture pixels within the bottom field block. The mean 
\ aluc .'l'both the defined and The padded pixels within the bottom field block can also be used to 
f II ilk transparent field block. If necessary, a middle value 2.sub.I.-l of all The possible values 
for an> texture pixel may be used based on the channel characteristics, wherein L is the number 
of bits assigned for each pixel. For example, if L is equal to 8, there are 256 texture pixels 0 to 
255 ard the middle value is .determined to be 128. 
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After all the interior and boundary blocks are padded as described above, in order to cope with a 
VOP of last motion, the padding must be further extended to undefined adjacent blocks, i.e.. 
exterior blocks which are adjacent to one or more interior or boundary blocks. The adjacent 
blocks can stretch outside the VOP, if necessary. At step S208, the undefined texture pixels in 
the undefined adjacent block are padded based on one of the extrapolated boundary blocks and 
the interior blocks to generate an extrapolated adjacent block lor the undefined adjacent block, 
wherein each extrapolated boundary block has a pari of the contour A of an object and each 
undefined adjacent block is shown as a shaded region as shown in FIG. 4. If more than one 
extrapolated boundary blocks surround the undefined adjacent block, one of the left, the upper, 
ihe right and the below extrapolated boundary blocks of the undefined adjacent block is selected 
:n this priority and, then, a vertical or a horizontal border of the selected extrapolated boundary 
block is repeated rightwards, downwards, leftwards or upwards, wherein the vertical or the 
horizontal border adjoins the undefined adjacent block. As shown in FIG. 4, the undefined 
adjacent blocks JB4, JB10, JR1 5, JB21 and JK2S select their respective left extrapolated 
boundary blocks a2, a5, a9, al3 and a!4; the undefined adjacent blocks JB20, JB27 and JB22 
select their respective upper extrapolated boundary- blocks al 0, al 4 and al 3; the undefined 
adjacent blocks J 13 1, JB9, J 13 14 and JBI9 select their respective right extrapolated boundary 
blocks al, a3, a6 and a 10; and the undefined adjacent blocks J B2 and JB3 select their respective 
he low extrapolated boundary blocks al and a2. A rightmost vertical border of the extrapolated 
boundary block a2 is expanded right ward to fill the undefined adjacent block JB4, a lowermost 
horizontal border of the extrapolated boundary block alO is expanded downward to fill the 
undefined adjacent block JB20 and so on. Also, undefined diagonal blocks such as Ml, M2, MS 
and M7 to Mil may be padded with a constant value, e.g., '128* to be the extrapolated adjacent 
block for the undefined diagonal block, wherein each undefined diagonal block is diagonally 
adjacent to the extrapolated boundary block and has all undefined texture pixels. 

As de?crihed above, at step S2I I , the extrapolated boundary and the extrapolated adjacent blocks 
l_s we!i as the interior blocks are stored. 

While the present invention has been described with respect to Ihe particular embodiments, it 
will be apparent to those skilled in the act that various changes and modifications ma> be made 
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without departing Irom the spirit and scope of the invention as defined in the following claims. 
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